Designing a Workload Scenario for Benchmarking Message-Oriented Middleware
نویسندگان
چکیده
Message-oriented middleware (MOM) is increasingly adopted as an enabling technology for modern informationdriven applications like event-driven supply chain management, transport information monitoring, stock trading and online auctions to name just a few. There is a strong interest in the commercial and research domains for a standardized benchmark suite for evaluating the performance and scalability of MOM. With all major vendors adopting JMS (Java Message Service) as a standard interface to MOM servers, there is at last a means for creating a standardized workload for evaluating products in this space. This paper describes a novel application in the supply chain management domain that has been specifically designed as a representative workload scenario for evaluating the performance and scalability of MOM products. This scenario is used as a basis in SPEC’s new SPECjms benchmark which will be the world’s first industry-standard benchmark for MOM.
منابع مشابه
Towards an Extensible Middleware for Database Benchmarking
Today’s database benchmarks are designed to evaluate a particular type of database. Furthermore, popular benchmarks, like those from TPC, come without a ready-to-use implementation requiring database benchmark users to implement the benchmarking tool from scratch. The result of this is that there is no single framework that can be used to compare arbitrary database systems. The primary reason f...
متن کاملRFID Middleware Benchmarking
This working paper presents our initial efforts to develop a benchmarking methodology for RFID middleware. In the paper, we conduct a context analysis to help focus the benchmarking on the right middleware features and metrics. Pairwise based workload generation is proposed to minimize the efforts and optimize the usefulness of the workload generated. A value driven benchmarking analysis framew...
متن کاملAutomated Performance Assessment for Service-Oriented Middleware
Middleware for Web service compositions, such as BPEL engines, provides the execution environment for services as well as additional functionalities, such as monitoring and self-tuning. Given its role in service provisioning, it is very important to assess the performance of middleware in the context of a Serviceoriented Architecture (SOA). This paper presents SOABench, a framework for the auto...
متن کاملA Reflective QoS-enabled Load Management Framework for Component-Based Middleware
A new reflective QoS-enabled load management framework for component oriented middleware is presented. The proposed framework offers the possibility of automatically selecting the optimal load distribution algorithms and changing the used load metrics at runtime, according to workload time evolution. QoS service level agreements are being offered at application level, transparent to the managed...
متن کاملPerformance evaluation of message-oriented middleware using the SPECjms2007 benchmark
Message-oriented middleware (MOM) is at the core of a vast number of financial services and telco applications, and is gaining increasing traction in other industries, such as manufacturing, transportation, health-care and supply chain management. Novel messaging applications, however, pose some serious performance and scalability challenges. In this paper, we present a methodology for performa...
متن کامل